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Abstract 

For Markov chains with a partially ordered finite state space we show strong stationary 
duality under the condition of Mobius monotonicity of the chain. We show relations of 
Mobius monotonicity to other definitions of monotone chains. We give examples of dual 
chains in this context which have transitions only upwards. We illustrate general theory by 
an analysis of nonsymmetric random walks on the cube with an application to networks of 
queues. 

Keywords: Strong Stationary Times; Strong Statianary Duals; Mobius function; Speed 
of convergence; unreliable queueing networks. 



1 Introduction 



The motivation of this paper stems from a study on the speed of convergence for unreliable 
queueing networks, as in Lorek and Szekli [15]. The problem of bounding the speed of convergence 
for networks is a rather complex one, and is related to transient analysis of Markov processes, 
spectral analysis, coupling or duality constructions, drift properties, monotonicity properties, 
among others (see for more details Dieker and Warren [10], Aldous [1], Lorek and Szekli [15]). In 
order to give bounds on the speed of convergence for an unreliable queueing network it is necessary 
to study the availability coordinate of the network process which is a Markov chain with the state 
space representing stations with a down status in the network. In other words the chain under 
study is a Markov chain for which the state space is the power set of the set of nodes, that is a 
chain representing a random walk on the vertices of the finite dimensional cube. We are especially 
interested in walks on the cube which are up-down in the natural (inclusion) ordering. To be more 
precise, recall that the classical Jackson network consists of M numbered servers, denoted by 
J := {1, . . . , d}. Station j G J is a single server queue with infinite waiting room under FCFS 
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(First Come First Served) regime. All the customers in the network are indistinguishable. There 
is an external Poisson arrival stream with intensity A and arriving customers are sent to node j 
with probability r-Qj, Yl'j=i^oj = r < 1. Customers arriving at node j from the outside or from 
other nodes request a service which is at node j provided with intensity ^j{n) (/Uj(0) := 0), where 
n is the number of customers at node j including the one being served. All the service times and 
arrival processes are assumed to be independent. 

A customer departing from node i immediately proceeds to node j with probability rij > or 
departs from the network with probability tiq. The routing is independent of the past of the system 
given the momentary node where the customer is. We assume that the matrix it! := (rjj , i,j e J) 
is irreducible. 

Let Yj{t) be the number of customers present at node j, at time i > 0. Then 

Y{t) = {Y,{t),...,Y,{t)) 

is the joint queue length vector at time instant t > and Y := {Y{t),t > 0) is the joint queue 
length process with the state space Z^J_. 

The unique stationary distribution for Y exists if and only if the unique solution of the traffic 
equation 

d 

Ai = Aroi + ^ Aj-rji, i^l,...,d (1.1) 

satisfies 

°° A" 

Q := 1 + V ' < oo, l<i<d. 

Assume that the servers at the nodes in the Jackson network are unreliable, i.e., the nodes 
may break down. The breakdown event may occur in different ways. Nodes may break down 
as an isolated event or in groups simultaneously, and the repair of the nodes may end for each 
node individually or in groups as well. It is not required that those nodes which stopped service 
simultaneously return to service at the same time instant. To describe the system's evolution we 
have to enlarge the state space for the network process as it will be described below. Denote by 
Jo := {0,1, ... ,d} the set of nodes enlarged by adding the outside node. 

• Let D (Z J he the set of servers out of order, i.e. in down status and IgJ\D.I^^ 
be the subset of nodes in up status. Then the servers in / break down with intensity 

• Let D G J he the set of servers in down status and H G D, H ^ The broken servers 
from H return from repair with intensity Pj^\jj{ni : i & J). 

• The routing is changed according to so-called Repetitive Service - Random Destina- 
tion Blocking (RS-RD BLOCKING) rule: For D - set of servers under repair routing 
probabilities are restricted to nodes from Jq\D as follows: 



rij, i,jeJo\D, iy^j, 

Tii + EfegD '^ife' ie Jo\D, i^j. 



9 



The external arrival rates are 

Ar^- = Aroj for nodes j e J\D, (1.2) 

and zero, otherwise. Let — {f'^)i,j€Jo\D be the modified routing. Note that — R. 

We assume for the intensities of breakdowns and repairs % ^ H <Z D and % ^ I d J \ D that 

n/D („. . j ^ J) .- V'(gu-f) 

I^D\H{^i : i e J) := <^(D\1) ' 

where ij) and are arbitrary positive functions defined for all subsets of the set of nodes. That 
means that breakdown and repair intensities depend on the sets of servers but are independent 
of the particular numbers of customers present in these servers. 

In order to describe unreliable Jackson networks we need to attach to the state space Z'^ of the 
corresponding standard network process an additional component which includes information of 
availability of the system. We consider the following state space 

n = {D, m, 712, ... , rid) e ViJ) X =: E = E X Z^[., 

where V{J) denotes the powerset of J. The first coordinate in n we call the availability coordinate. 

The set D is the set of servers in down status. At node i E D there are rii customers waiting for 
server being repaired. Denote possible transitions by 



Tijh 
Tioh 



{D,ni, . . . ,ni - 1, . . . ,nj + 1, . . . ,nd), 
{D,ni, ...,nj + l,.. .,nd), 

{D,ni,...,ni-l,...,nd), (1.3) 

{D \ H,ni, . . .,nd), 

{DUl,ni,...,nd). 



The Markov process Y = {{X{t), Y{t)),t > 0) defined on the state space E by the infinitesimal 
generator 

d d d 

Qf{n)= ^[/(ro,ii)-/(fi)]Aro^. + ^[/(r,,n) - /(n)]/.,(n,)r,^+ 

d 

J2[f{Tjon) - f{n)]fij{n,)rf, 

is called unreliable Jackson network under RS-RD blocking. The coordinate X{t) is called 
availability coordinate. It takes vales in E = 7^(7). 

Similarly to classical Jackson networks the invariant distribution for this Markov process can 
be written in a product form, see Sauer and Daduna [17]. Moreover the question about speed 



of convergence for the network process Y can be decomposed into a set of simpler questions 
about speed of convergence for the chain (X„)n>o imbedded in the availabihty Markov process 
{X{t),t > 0), and the arising from the product formula birth and death processes, see e.g. Daduna 
and Szekli [6]. 

In this paper we shall concentrate our attention on the availability chain. We utilze strong 
stationary duality which is a probabilistic approach to the problem of speed of convergence to 
stationarity for Markov chains introduced by Diaconis and Fill [8] . This approach involves strong 
stationary times introduced earlier by Aldous and Diaconis [2] , [3] who gave a number of examples 
showing useful bounds on the total variation distance for convergence to stationarity in cases where 
other techniques utilizing eigenvalues or coupling were not easily applicable. A strong stationary 
time for a Markov chain (Xn) is a stopping time T for this chain for which Xt has stationary 
distribution and is independent of T. Diaconis and Fill [8] constructed an absorbing dual Markov 
chain with its absorption time equal to the strong stationary time T for 

In general, there is no recipe how to construct dual chains. However, few particular cases 
are tractable. One of them, as Diaconis and Fill [8] (Theorem 4.6) prove, is when the state 
space is linearly ordered. In this case, under the assumption of stochastic monotonicity for the 
time reversed chain, and under some (mlr) conditions on the initial distribution it is possible 
to construct a dual chain which is a birth and death process on the same state space but with 
absorption, for which the time to absorption allows for a simpler analysis. 

In Section 3 we generalize this construction, using Mobius monotonicity instead of stochastic 
monotonicity, and using a partially ordered space. This construction is of independent interest. 
It turns out that in many cases the resulting dual chain is an analog of pure-birth chains, its 
transitions are not-downwards. 

Utilization of Mobius monotonicity involves a general problem of inverting a sum ranging over 
a partially ordered set which appears in many combinatorial contexts see e.g. Rota [18]. The 
inversion can be carried out by defining an analog of the difference operator relative to a given 
partial ordering. Such an operator is the Mobius function, and the analog of the fundamental 
theorem of calculus obtained in this context is the Mobius inversion formula on a partially ordered 
set, which we recall in Section 2. 

2 Mobius function and monotonicity 

Consider a finite, partially ordered set E = {ei, .... sm}- and denote a partial order on E, by ^. 
We select the above enumeration of E to be consistent with the partial order, i.e. ^ implies 

i < j. 

Let X = {Xn)n>o ~ i'^, P) be a time homogeneous Markov chain with an initial distribution u 
and its transition function P on the state space E. We identify the transition function with the 
corresponding matrix written for the fixed enumeration of the state space. Suppose that X is 
ergodic with the stationary distribution tt. 

We shall use A for meet (greatest lower bound) and V for the join (least upper bound) in E. If 
E is a lattice, it has the unique minimal and the unique maximal elements, denoted by ei := 
and Bm '■— 1, respectively. 
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Recall that the zeta function ( of the partially ordered set E is defined by: Ci^i^ ^j) — 1 if ^ 
and C(6i, e^) = otherwise. If the states are enumerated in such a way, that ej :< implies i < j 

(assumed in this paper), then ( can be represented by an upper-triangular, 0-1 valued matrix C, 
which is invertible. It is well known that ( is an element of the incidence algebra (see Rota [18], 
p. 344), which is invertible in this algebra, and the inverse to (, denoted by ii is called Mobius 
function. Using the enumeration which defines C, the corresponding matrix describing is given 
by the usual matrix inverse C~^. 

For the state space E = {ei, . . . , Bm} with the partial ordering :< we define the following oper- 
ators acting on all functions / : E — >■ R 

SJ{e^) = /(e)C(e, e,) = ^ /(e) =: F(e,), (2.5) 

eeE e:e:<ei 

and 

St^) = E e)/(e) = m =■■ (2.6) 

eeE e.e>zei 

In the matrix notation we shall use the corresponding bold letters for functions, and we have F = 
fC, F = fC^, where f = (/(ei), . . . , /(e^)), F = (F(ei), . . . , F(eM)), and F = (F(ei), . . . , F(eM)). 

The following difference operators and D-^ are the inverse operators to the summation oper- 
ators and S^, respectively 

DJ{ei) = J2 fi^M^^ ^i) = E /(^)'"(^' - 9{ei), (2.7) 

eeE e.e^et 

and 

Dtfiei) = E/^(^-^)/(^) = E /^(e-e)/(e) =: h{e,). (2.8) 

eeE e:e^ei 

In the matrix notation we have g = fC~^, and h = f(C^)~^. 
If, for example, the relations (2.5) and (2.6) hold then 

/(e,) = E ^(e)/^(e,e,) = D^iSJiei)), (2.9) 

e:e:<ej 

and 

/(e,) = E /^(e^,e)F(e) = D^{S^f{e,)), (2.10) 

e:e>:ej 

respectively. 

Definition 2.1. For a Markov chain X with the transition function P, we say that P (or alter- 
natively that X. ) is 

^-Mobius monotone if 

C-1PC>0, (2.11) 

-Mobius monotone if 

(C^)-^PC^ > 0, (2.12) 



where P is the matrix of the transition probabilities written using the enumeration which defines 
C, and > means that each entry of a matrix is non-negative. 

Definition 2.2. Function f : E ^ is 

^-Mobius monotone if f(C-^)~^ > 0, 
"^-Mobius monotone if fC~^ > 0. 

For example, in terms of the Mobius function and the transition probabihties, \,- Mobius 
monotonicity of P means that for all (ej, e E) 

^ /i(e„e)P(e,{e,}^)>0, 

where P(-, ■) denotes the corresponding transition kernel, i.e. P(ej, {e^}-'') = X]e e-<e- -P(^i) ^)) ^^^^ 
{Gj}^ = {e : e ^ ej}. In order to check such a condition an explicit formula for fi is needed. Note 
that the above definition for monotonicity can be rewritten as follows, / is -'--Mobius monotone if 
for some non-negative vector m > 0, it holds f = mC^, and / is "^-Mobius monotone if f = mC. 
The last equality means that / is a non- negative linear combination of the rows of matrix C. 
This monotonicity implies that / is non-decreasing in the usual sense (/ non-decreasing means: 
Bi ^ Gj implies f{ei)< f{ej)). 

Two probability measures 7ri,7r2 G E are (strongly) stochastically ordered (we write tti :<st 7^2) 
when TTilA) < 7T2{A) for all upper sets A i.e. sets such that ^4 = {e : e >: ej for some ej in 
A}. 

P is stochastically monotone if one of the equivalent conditions holds 

(i) if TTi :<st 7^2 then ttiP :<st vr2P, where ttiP denotes the usual multiplication (vector by 
matrix) with the fixed enumeration of coordinates, 

(ii) if ej ^ then P(ei, A) < P{ej, A), for all upper sets A, 

(iii) if / is non-decreasing then Pf^ is non-decreasing . 

For linearly ordered spaces, conditions (2.12) and (2.11) are equivalent and they define the above 
(strong) stochastic monotonicity of P (see Keilson and Kester [14]). 

For arbitrary partially ordered spaces strong stochastic monotonicity need not imply Mobius 
monotonicity, as will be seen later in this paper. Also Mobius monotonicity does not imply the 
strong stochastic monotonicity in general. However, as noted by Massey [16], Mobius monotonicity 
implies a weak stochastic monotonicity. To be more precise, let us recall the definitions of weak 
stochastic monotonicities. 

Definition 2.3. 

P is ^- weakly monotone if for all tti ^4, 1:2 it holds ttiP ^4, 7^2P, where tti 7r2 when for 
all eiGE, 7ri({ei}^) <7iii{ei}^) 



P is weakly monotone if for all tti t:^ it holds ttiP 1^2^, where tti ^-|- 1^2 if 
T^iii^iV) < 7r2({e,}''~) holds for all {ej}^ := {e e E : ^ e}. 

It is possible to characterize ^- weak monotonicity of P as an invariance property when P is 
acting on the following subset T of functions: ^ := {/ : TTif^ < 7r2f^, V tti 7r2}. We skip an 
analogous formulation for weak monotonicity of P. 

Lemma 2.4. P is weakly monotone iff 

f ^ J- implies Pf^ e J- , for all f . 

Proof. Suppose that f & T implies Pf-^ e and take arbitrary tti 712. For arbitrary 
/ G J-" wc have then TTif'^ < 712^'^, and vriPf'^ < 7r2Pf'^. Since /(e) = I{{ei}t}(6) G ^ we have 
7riP({ej}''') < 7r2P({ej}'''), that is ttiP 7r2P. Conversely, suppose that for all tti H2 implies 
TTiP ^2P- Take arbitrary f E J-'. Then for all tti 7T2, TTif^ < TT2i^, and TTiPf"^ < 7r2Pf"^, 
which implies that Pf^ G J-". □ 

Similar orderings to the weak stochastic orderings ^-|-, and ^4, were studied by Xu and Li [19] 
for distributions on the d-dimensional cube. It is reasonable to consider an ordering defined by 
requiring both weak stochastic orderings at the same time, which results in a kind of dependency 
order (see Xu and Li [19] for details). 

Lemma 2.5. 

^-Mobius monotonicity ofP implies ^- weak monotonicity ofP 
and 

^-Mobius monotonicity ofP implies ^- weak monotonicity of P. 

Proof. We shall prove only the first implication, the second one can be obtained by replacing 
with C in the argument. Let M = (C"^)^-'^PC'^ > 0. We have to show the '''weak monotonicity 
of P which is equivalent to the property that ttiP 7r2P, for all tti 1:2. Suppose that 
TTi ^1 7r2, this means in terms of C that ttiC^ < 7r2C^, coordinatewise. Note that '''-Mobius 
monotonicity of P is equivalent to PC^ = C^M. Multiplying the inequahty ttiC^ < 7r2C^ by 
M (it is non- negative) we obtain ttiC^M < 712 C^M, and using ''^-Mobius monotonicity we get 
TTiPC^ < 7r2PC^, which imphes that ttiP 7r2P. 

□ 

The above result for monotonicity was, independently from Massey [16], given by Fahn [11] in 
his Theorem 2. 

It is also possible to characterize ^-Mobius monotonicity of P as an invariance property when P is 
acting on the set of all ^-Mobius monotone functions. Note that this set is strictly smaller than J-'. 
Indeed, taking two probability measures tti it2 on {0, 1}^, we have always 7r2({(0, 1), (0, 0)}) < 
7ri({(0, 1), (0, 0)}), and 7r2({(l, 0), (0, 0)}) < 7ri({(l, 0), (0, 0)}), and for / such that /((0, 1) = -1, 
/((1,0)) = -1, /((0,0)) = -1 /((1, 1)) = we have ttiF < 772^, hence / G J", but / is not a 
^-Mobius monotone function. We skip the corresponding formulation for -'--Mobius monotonicity 
of P. 
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Lemma 2.6. P is ^-Mobius monotone iff 

f is ^-Mobius monotone implies that Pf^ is ^-Mobius monotone. 

Proof. Suppose that P is ''"-Mobius monotone, that is (C^)~^PC^ > 0. Take arbitrary / which 
is "^-Mobius monotone, i.e. take f = mC for some arbitrary m > 0. Then (C-^)~^PC'^m'^ > 0, 
which is (using transposition) equivalent to fP^C~^ > 0, which in turn gives (from definition) that 
Pf"^ is ^-Mobius monotone. Conversely, for all f = mC, where m > 0, we have fP-^C^^ > 0, since 
PF is ^-Mobius monotone. This implies that (C^)-^PC^m^ > 0, and (C^)-^PC^ > 0. □ 

In general, weak stochastic monotonicity does not imply Mobius monotonicity (see Massey [16] 
or Falin [11] for counterexamples). 

We shall give more examples of Mobius monotone chains later. However, many examples can 
be produced using the fact that the set of Mobius monotone matrices is a convex subset of the 
set of transition matrices. 

Lemma 2.7. 

(i) //Pi andP2 are^-Mobius monotone (^-Mobius monotone) thenPiP2 is^-Mobius monotone 
(^-Mobius monotone). 

(ii) If P is ^-Mobius monotone ( ^-Mobius monotone) then (P)^ is ^-Mobius monotone ( ^- 
Mobius monotone), for each k 

(Hi) If Pi is^ -Mobius monotone (^-Mobius monotone) and P2 is^ -Mobius monotone (^-Mobius 
monotone) then 

pPl + (l-p)P2 

is '''-Mobius monotone (^-Mobius monotone), for all p G (0, 1). 
Proof Ad (i). Since (C^)-iPiC^ > 0, and (C^)-iP2C^ > then 

(C^)-iPiP2C^ = ((C^)-iPiC^)((C^)-iP2C^) > 0. 
The statements (ii), (iii) are immediate from definition. □ 

3 Strong stationary duality for ^-Mobius monotone chains 
3.1 Time to stationarity 

One possibility of measuring distance to stationarity is to use separation distance (see Aldous and 
Diaconis [3]). Let s(i/P",7r) = maXegE (1 — z^P"(e)/7r(e)). Separation distance is an upper bound 
on total variation distance: s(i/P"',7r) > d(i/P",7r) := meiXBCE \i^P'^{B) — 7r{B)\. 

A random variable T is a Strong Stationary Time (SST) if it is a randomized stopping time 
for X = {Xn)n>o such that T and Xt are independent, and Xt has distribution tt. SST was 
introduced by Aldous and Diaconis in [2, 3]. In [3] they prove that s(i/P",7r) < P{T > n) {T 
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implicitly depends on u) . Diaconis [7] gives some examples of bounds on the rates of convergence 
to stationarity via SST. However, the method how to find SST was specific to each example. 

Diaconis and Fill [8] introduced so-called Strong Stationary Dual (SSD) chains. Such chains 
have a special feature, namely for them the SST for the original process has the same distribution 
as the time to absorption in the SSD one. 

To be more specific, let X* be a Markov chain with transition matrix P*, initial distribution u* on 
the state space E*. Assume that e* is an absorbing state for X*. Let A = A(e*, e), e* e E*, e G E 
be a kernel, called a link, such that A(e*, ■) — n for e* G E*. Diaconis and Fill [8] prove, that if a 
(i/*, P*) is a SSD of {u, P) with respect to A in the sense that 

u = u*A and AP = P*A, (3.13) 

then there exists a bivariate Markov chain (X, X*) with the following marginal properties: 

X is Markov with the initial distribution v and the transition matrix P, 
X* is Markov with the initial distribution v* and the transition matrix P*, 
the absorption time T* of X* is a SST for X. 

This means, that once one finds a SSD chain for a given chain, then the problem of finding 
the distribution of SST for the original chain can be translated into the problem of finding the 
distribution of the time to absorbtion in SSD chain. However, there is no general recipe on how 
to find a fink, and a SSD chain. It is also not clear that the absorbtion time in a SSD chain will 
always be easier to study than the SST time in the original chain. However the case of hnearly 
ordered spaces is a convincing example that it is worth trying to realize such a scenario. In this 
case, if the original chain is a birth and death process then it is possible to find SSD which is 
a birth-birth process with absorption. In this paper we find an analog of this situation, starting 
with some up-down chains we find SSD chains which do not jump downwards or even chains which 
are jumping only upwards. Details will be presented in the next section. 

3.2 Main result 

Recall that Sc — 0(n)n>o is the time reversed process if its transition matrix is given by 

^ = (diag(7r))-ip^(diag(7r)), 
where diag(7r) denotes the matrix which is diagonal with the stationary vector tt on the diagonal. 

Theorem 3.1. Let X ~ (z/, P) be an ergodic Markov chain on a finite state space E = {ei, . . . , e^}; 
partially ordered by with an unique maximal state eM, and with the stationary distribution tt. 
Assume that 

(i) g{e) = ^||y is ^-Mobius monotone, 

(a) is X-Mobius monotone. 
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Then there exists Strong Stationary Dual chain X* ~ (z/*, P*) on E* = E with the following link 
kernel 

A(e,-,e,)=I(e,^e,-)-|^, 
where H{ej) = S_iTr{ej) = ^e e^^j ^i^) ~ t^^)- Moreover, the SSD is uniquely determined by 
v*{ei) = H{ei) Ee:ehei /^(^i, e)c/(e) = Sin{ei)D^g{ei), e E, 

P*(e„ e,) = Ee:e^e, /^(e., e) V(e, {e,H) = |^i^t^(e,, {e,p), e„ e, e E. 

The corresponding matrix formulas are given by 

i.* = g(C^)-Miag(7rC), (3.14) 

P* = (diag(H) C~^1pC diag(H)-i)'^ = (3.15) 
= diag(7rC)-^(C^diag(7r))P(C^diag(7r))-Miag(7rC), (3.16) 

where g = {gi^i, ■ ■ ■ , g{e-M)) (fow vector). 

Proof. We have to check the conditions (3.13). The first condition given in (3.13) reads for 
arbitrary G E 

Ke.) = 5:^*(e)^ (3.17) 

which is equivalent to 

Prom the Mobius inversion formula (2.10) we get 



which gives the required formula. Prom the assumption that g is 4,-Mobius monotone it follows 
that V* > 0. Moreover, since v* — vA, and A is a transition kernel, it is clear that u* is a 
probability vector. 

The second condition given in (3.13) means that for all e^, e E 

5^A(ei,e)P(e,e,) = P*(ei, e)A(e, e,). 

eGE egE 

Taking the proposed A we have to check that 



in 



that is 

_1_ ^ T(e) , _ P'(e.,e) 

Using ^P(e, e^) = "^(e^, e) we have 

(3.18) 



For each fixed ej we treat jjj^ P {^j, {^i}^) as a function of e^- and again use the Mobius inversion 
formula (2.10) to get from (3.18) 

In the matrix notation we have 

C-^PC(e,,e,-)= Yl /^(ei,e)P(e,{e,H), 

e:e>:ej 

therefore 

P* = (diag(H) C-^PC diag(H)-^)^. 

Since, from our assumption, C~^^C > 0, we have P* > 0. Now AP = P*A imphes that P* is a 
transition matrix. □ 

In a similar way we construct an analog SSD chain for ^-Mobius monotone P. We skip the 
corresponding matrix formulation and a proof. 

Corollary 3.2. Lei(X~ {i^,P) bean ergodic Markov chain on a finite state space K = {ei, ... ,eM}, 
partially ordered by :<, with an unique minimal state ei, and with the stationary distribution n. 
Assume that 

(i) g{e) — is ^-Mobius monotone, 

(a) is "[-Mobius monotone. 

Then there exists Strong Stationary Dual chain X* ~ {u*, P*) onK* — K with the following link 

A-(e,-,eO = I(e,^e,-)^^, 

where H{ej) = S^7:{ej). Moreover, the SSD is uniquely determined by 
p'{ei) = H{ei) Ee:ede. £/(e)/^(e, e^) = S^n{ei)D^g{ei), e E, 

P-(e„ e,) = |g Ee:e^e, ^(e, {eiVMe, e,) = ^i?^^(e„ {e,}t), e„ e, e E. 

1 1 



For E = {1, . . . , M} with the hnear ordering < we obtain the Theorem 4.6 from Diaconis and 
Fill [8] as a special case. We use the fact that in this case iJi{k,k) — l,iJi{k — l,k) — —1 and ji 
equals otherwise. 

Corollary 3.3. LetX. ~ {u, P) be an ergodic Markov chain on a finite state space E = {1, . . . , M}, 

linearly ordered by <, with the stationary distribution tt. Assume that 

(i) g{i) = ^ is non-increasing, 

(a) ^ is stochastically monotone. 

Then there exists Strong Stationary Dual chain X* ~ (z/*, P*) on E* = E with the following link 
kernel 

where H{j) = Ylik-k<3'^^^) ■ Moreover, the SSD is uniquely determined by 
= H(i) Ek:k>il^(h k)g{k) = H{z){g{i) - g{i + 1)), i e E, 



^ ' k:k>j 

§^{^{J, {I,..., ^}) - ^(J + 1, {1, • • • , ^})), ^,J e E. 

An analog of the above result, corresponding to t-Mobius monotonicity is as follows. 

Corollary 3.4. Let X ~ (i/, P) be an ergodic Markov chain on a finite state space E = {1, . . . , M}, 
linearly ordered by <, with the stationary distribution tt. Assume that 

(i) g{i) — ^ is non- decreasing, 

(a) ^ is stochastically monotone. 

Then there exists Strong Stationary Dual chain X* ~ (i/*, P*) on E* = E with the following link 
kernel 

where H{j) — 'Ylik-k>j ^{k) ■ Moreover, the SSD is uniquely determined by 
= H{t) Ek:k<^l^ik, ^)9ik) = H{i){g{i) - g{i - 1)), t G E, 

^Cp{3. 0, • • • , M}) - ^{j - 1, {i, . . . , M})), ij e E. 
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Remarks. 

1. In Theorem 3.1 we have A(eM, •) = is an absorbing state for P*. Moreover, if the 
orignal chain starts with probabihty 1 in the minimal state, i.e. u — 5ei, so does the dual chain. 
In Corollary 3.2 wc have A*(ei, ■) = vr and ei is an absorbing state for the dual P*. Moreover, if 
the orignal chain starts with probability 1 in the maximal state, i.e. u — 5^^, so does the dual 
chain. 

2. A well-known theorem, usually attributed to Keilson, states that, for an irreducible continuous- 
time birth-and-death chain on E = {0, . . . , M}, the passage time from state to state M is dis- 
tributed as a sum of M independent exponential random variables. Fill [12] uses the theory of 
strong stationary duality to give a stochastic proof of an analogous result for discrete time birth 
and death chains and geometric random variables. He shows a link for the parameters of the 
distributions to eigenvalue information about the chain. The obtained dual is a pure birth chain. 

3. An (upward) skip-free Markov chain with the set of nonnegative integers as state space is a 
chain for which upward jumps may be only of unit size; there is no restriction on downward jumps. 
In Brown and Shao [5] determined, for an irreducible continuous-time skip-free chain and any M, 
the passage time distribution from state to state M. When the eigenvalues of the generator 
are all real, their result states that the passage time is distributed as the sum of M independent 
exponential random variables with rates equal to the eigenvalues . Fill [13] gives another proof of 
this theorem. In the case of birth-and-death chains, this proof leads to an explicit representation 
of the passage time as a sum of independent exponential random variables. Diaconis and Miclo 
[9] recently obtained such a representation, using an involved duality construction. 



3.3 Nearest neighbor Mobius monotone walks on cube: one station 
repair or failure 

Consider discrete time Markov chain X = {Xn, n > 0}, E = {0, 1}*^ with the transition matrix P 
given by. 



P(e,e-FSj) = aiI{ei=o}, 
P(e,e-Sj) = AI{ei=i}, 



(3.19) 



P(e,e) = 1- ^ a, - 5^ A, 

i:ei=0 i:ei=l 

where e = (ei, . . . , Cfi) G E, Cj G {0, 1} and Sj = (0, . . . , 0, 1, 0, . . . , 0) with 1 at the position i. 
Assume that and /3j are such that the chain is ergodic. 
This chain is time-reversible with the stationary distribution 

i:Xi=l i:xi=0 



We use the following partial ordering: e = (ei, 62, . . . , e^) :< e' — (e'j^, e'g, . . . , e^) if ej < e^, for all 
i — 1, . . .d. Let |e| = X]j=i Cj. For this ordering Mobius function is known and is given by 



li{e,e') 

We shall calculate 



ife^e', 
otherwise. 



^ ^^^^ e:ete,- 

and find conditions for its non-negativity. 

P*((0,---,0),(0,...,0))= Yl M(0,---,0),e)V(e,{(0,...,0)}J-) 

d d 

= 1 - (ai + . . . + Old) - A - ■ ■ ■ - = 1 - XI «i - 

i=l i=l 

Thus, we must have 

d d 
i=l i=l 

Note that this condition is equivalent to the condition that all eigenvalues of P are non-negative. 
Fix Si = (0, . . . , 0, 1, 0, . . . , 0) with 1 on the position i. Then 

d d 

P*(sj, Si) = X //(sj, e) V(e, {siY) = 1 - ^ afe + - ^ + A- 

e:e>:Si k=l k=l 

For each state of the form e* = (ei, . . . , Cj-i, 0, Cj+i, . . . , e^), 

P-(e\e- + s.) = ^gy^ 5^ Me^ + s.,e)^(e,{e^}^) 



(/i(e^ + s„ + s,)^(e^ + s„ {e^}^)) = 



Denote by z{e) — {k : Ck — 0}, the index set of zero coordinates. We shall compute 
LetG = nLK- + ^.-)- 



H(e^)= y: ^(e)=^ e n n /^^=^ n /^h e H".- n 

e:e^e» e:e^e* A;:efc=l k:ek=0 fe:ei=0 \ AC{l,...,d}\z(e') jeA jeAC' 



H{e' + s,)^ J2 n{e)=H{e^)+ J] 7r(e) 



e,- = l 



And thus 



and 



= Hie^) + ^ n /^'^"^ ( E n«^- n 

fc:efc=0 \AC{l,...,d}\z{ei) jeA jeA^ J 

fc:e|=0 \AC{l,..,d}\z(e') jeA jgA^ ^ 



if(e* + Si) _ _^ _ «i + A 



P*{e\e' + Si) = ai + f3i. 
Now, fix some *e = {ei, . . . , e^-i, 1, e^+i, . . . , e^}. 

^ e:e^ 'e-Sj 

Fix J e {1, . . . , d} \ z{''e). Tlie following cases are possible: 

e = 'e - Si : //('e - Sj, *e - Si)'^(^e - Sj, {'e}-"-) = 1 - ^ 

e = *e : /x^e - s^, 'e)^{'e, {'e}^) ^ ~ W ~ E 

\ feez('e) 

e = 'e — Sj + Sj : //('e — Sj, *e — Sj + s^) V( — Sj + Sj, {'e}-'-) = —Pj 
e= ^e + Sj-. /x(*e — Sj/ e + Sj)^( *e + Sj, {*e}^) = /5j 

Summing up all possibilities we get 

P*(Ve-s,) = 0. 

For each e we have 

P*(e,e)= Yl Me,e')P(e',{eH) 

e':e'^e 

e' = e: //(e, e)^(e, {e}-'-) = l - 

e' = e + Si: /x(e, e + Sj) P(e + Sj, {e}-'-) =-l-A- 

Therefore we get 

P*(e, e) = /i(e, e)^(e, {e}^) + J] /x(e, e + s,)^(e + s,, {e}^) = 1 - J] (a, + A)- 

i62(e) «62(e) 
IK 



It is interesting that the dual (absorbing) chain here is a chain which jumps only upwards to 
neighboring states or stay at the same state. This structure of the dual chain allows to read all 

eigenvalues for P and P* (from the diagonal of P* ) since the dual matrix P* is an upper-triangular 
matrix. The symmetric walk «j = /3j = (1 — r)/(i, was considered by Diaconis and Fill [8]. They 
used the symmetry to reduce the problem to a birth and death chain. The non-symmetric case 
was studied by Brown [4] were the eigenvalues were identified by a different method. Using Brown 
[4] we can reformulate his result as follows. 

Theorem 3.5. Suppose X = {X^, n>0} is defined by (3.19). Assume that X]f=i + Z]iLi A < 

1. Define At to be a set of (^) subsets of size k from {1, . . . ,d} and s^ = ^i^^{o(i + (3i) for 7 a 
subset of 1, ... ,d. Then for the separation distance, and 5(o,...,o) the atomic measure at {0, ... , 0) 
we have 

d 

ii) «(<5(o,...,o)P", tt) = Y.^-lf-' 5] (1 - s,)\ n > 1, (3.21) 

k=l 7eAfc 

{a) all 2^ eigenvalues of P are {1 — s-y, 7 C {1, . . . , d}}. (3.22) 

We recognize {i) as an inclusion-exclusion formula: consider n multinomial trials with cell prob- 
abilities Pi — ai + ^i, i — 1, . . . , and pd+\ = 1 — Ylt=i{'^i + A)- Let An be the event that at 

least one of the cells from 1, . . . , is empty. Then A„ = Uf^^C,;, where Cj = 1 if cell i is empty, 
otherwise. Then (i) represents the inclusion-exclusion formula for P(U^^^Cj). Thus if we denote 
T to be the waiting time for all of cells 1, . . . , d to be occupied, then 

s{5.^^^^\7:)=P{T>n) = P{An). 

Example 3.6. Consider the following random walk on the two-dimensional cube: E = {0, 1}^. 
We define on E the partial ordering: for all e = (ei, 62) G E, e' = (e^, e'2) G E 

e d e' <^=^ ei < e'^, 62 < e'2. 

We consider the transition matrix under the state space enumeration: 



of the form 



= (0,0),e2 


= (1,0), 63 = 


(0,1), 64 = 


(1,1), 


Oi\ — (X2 


ai 


a2 





/9i 1 


- /3i-a2 









1 


-ai- /32 


«! 





f32 




1 - /3i - /32 



We assume that cti, tt2, /32 are positive and that there exists B C K such that ^^eB^k + 
^^g^c > (which assures irreducibility of the chain). 

The zeta, and the Mobius functions are represented by 



1111 

10 1 
11 
1 



c 



-1 



1 







-1 -1 

1 

1 





For ''"-Mobius monotonicity we have 



(c^)-ipc^ = 



P is ^-Mobius monotone iff 



1 




Ot2 





1 - ai - /3i 























^(«i + A)<i- 



CCi 





0L2 - 



(3.23) 



For -'--Mobius monotonicity we liave 



(y.\ — 0L2- 




^2 

\- a2- ^2 
1 





a\ - 

/3i 






/3i 
1 



Again, P is -'--Mobius monotone iff X^j(Q;j + A) < 1- Notice tliat tlie above matrix is similar 
to P and liave an upper-triangular form, so the eigenvalues of P are given on the diagonal 
of this matrix. If we assume that a\ = a2 = a, and (3i = (^2 = P then the dual matrix P* 
has also a simple form (again with the eigenvalues on the diagonal), 



-2a + 1 






2p p + a 
-« + 1 - , 





-a 



We have moreover 



P' 



1 

/3 + a 
/3 + a 






-a + 1 - 


6 + a 



/3 






-a + l-(3 
6 + a 



+ a 

p + a 

/3 /3 + a 
1 







-2a + 1 



2/3 



3.4 More general walks on cube 

Consider first the random walk on the three-dimensional cube: E = {0, 1}'^. We define on E the 
partial ordering: for all e = (ei, 62, 63) e E, e' = (e^, 63, 63) e E, e ^ e' iff ei < e[, 62 < 62, 63 < 63. 

We consider the transition matrix under the state space enumeration: 

ei = (0,0,0), 62 = (1,0,0), 63 = (0,1,0), 64 = (0,0,1), 65 = (1,1,0), 66 = (1,0,1), 67 = 

(0, 1, 1), eg = (1, 1, 1) of the form 
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Pi ^ 



1 - 3a 

IS 
13 
P 







I - P - 2a 


/3 
P 







- P - 2a 






- 2/3 - 








-2/3 - 



with the dual 



1 - 3a - 









-2/3 + 1 - 










-2/3 + 1 - 2a 









- P - a 







■ /3 - a 










P + a 

P + a 
P + a 



One possibihty to extend the model to allow up-down jumps not only to neighboring states, 
that is to model repairs and failures of more than one station at one transition of the process, is 
to take powers of the nearest neighbor transitions matrix Pi. The matrix P = Pf is again Mobius 
monotone, and has the dual with an upper-triangular form. To be able to present this matrix in 
display form we take a — 13. 



p* 



1 - 12 a -I- 36 a 










4a - 20 a^ 
8 a -I- 16a^ - 









4a - 20a^ 


8 a -H 16a^ -H 1 








4a - 20a 



8 a -H 16a^ - 







8a^ 
-4 a (3 a - 1) 
-4 a (3 a - 1) 



4a^ - 4a + 1 






8 a^ 
-4 a (3 a - 1) 


-4 a (3 a - 1) 


4a^ - 4a -H 1 





-4 a (3 a - 1) 
-4 a (3 a - 1) 





4a^ - 4a -I- 1 






8a^ 

8a^ 

8 a^ 
-4a^ + ia 
-4 a^ -t- 4 a 
-4 a^ -t- 4 a 
1 



Another way to modify the nearest neighbor walk is to transform some rows of P to get distribu- 
tions bigger in the supermodular ordering. To be more precise, recall that we say that two random 
elements X,Y oiK are supermodular stochastically ordered (and write X -Kg^n ^ or y )^sm X) if 
Ef{X) < Ef{Y) for all supermodular functions, i.e. functions which fulfill for all x, y e E 

f{xAy) + f{xyy)>f{x) + f{y). 



A simple sufficient criterion for -<sm order for E which is a discrete (countable) lattice is given 
as follows. 

Lemma 3.7. Let Pi be a probability measure on a discrete lattice ordered space E and assume 
that for not comparable points x ^ y E K we have Pi{x) > n and Pi{y) > n for some k > 0. 



IS 



Define a new probability measure P2 on E by 



P2{x)= Pi{x)-K P2{xyy)= Pi{xyy) + K 

P2{y)= Pi{y)-n P2{xAy)= Pi{xAy) + K 

P^[z) = Pi{z) otherwise. (3.24) 

Then Pi -<sm ^2- 



If in Lemma 3.7 the state space E is the set of all subsets of a finite set (i.e. the cube) than the 
transformation described in (3.24) is called in Li and Xu [19] a pairwise transform and Lemma 
3.7 speciahzes then to Proposition 5.5., Li and Xu [19]. 

If we modify rows numbered 1,3,6,8 by such a transformation (notice that ei, 63, ee, eg lie on a 
symmetry axis), that is we consider an up-down walk which allows jumps not only to the nearest 
neighbors with the transition matrix 



1 - 3 a 


a 

Q — K 








1 - 3a - 







1 - 3a 




a 

oc — K 


1 - 3a 




a — re 





- 3a - 








1 - 3 a 



1 — 3 a + re 



then the dual matrix again has an upper-triangular form 



p* 



1 - 6a +2re 










-4a + 1 









2a 


-4a + 1 - 











-4 a- 








2a 





1 - 2a 






2a 


2a 



1 - 2a 










la 



1 - 2 a 










2a 
2a 

2 a 
1 



which allows to read the eigenvalues ( for appropriate selection of a and k). 

There are several other examples of chains which are Mobius monotone, with transitions to 
non-comparable states on the cube, and walks on some other state spaces, but we shall study this 
topic in a subsequent paper. 
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